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ERIC: 


_ project pesu Lied from Request for Proposals, “NIE- R- 79~ 0012. The: project 


Teaching and Learning (Tyler § White, 1981), am offshoot of the 1977 — , 
Education and Welfare, to" igentity: the reasons. for. the decline in achieve- : 
ment ‘test scores. Participants at the Secretary's conference aeguedl that 
effective and could serve more important purposes i it was done correctly. 


making educational deeisions about individuals and about ‘the effectiveness 


of programs, particularly in light. of new information emerging from Studies 
Ps \ . , - 


"INTRODUCTION - 


a 


i ‘The Assessment of Language Proficiency of 81 ingual ‘Persons (ALPSP) 


had at rere four points of origin. Each is ‘briefly summaries in order = (a7 ee] 


to provide perspective on the ‘AL°SP project 


4 . ‘ - .- , 


te ; 7 . . . ee. a 
The first point of origin was the 1978 Falmouth: Conference on Testiag,~ | 


Conference called by Secretary Califano, of tHe Department. of iasehs 


nm 


some of the decline could be attributed ‘to the use, ae inappropriate tests. 


The Falmouth Conference participants. concluded that testing could be more . 


, 


, 


They saw rae sole. use. of ‘standardtzed eeeing as an unrealistic me thod | of ; 


: , / 
related to human cognition. They urged Federal support of new approaches to 


whey 


testing: 


: Hows are we to pursue this. vision of. testing merged into 3. . 
teaching~testing system, fitted to the natural él'assroom situay 
tion, drawing upon the cognitive scientists and teachers and = * 

.scholars in the subject areas, and exploiting the rapidly ~ 
developing information =hand]ing technology? Oné-way is to - 


_continue and perhaps expand support for. research on classroom Pee, 


process and human-cognition, and for the development of new ° 

technological ly-based testing, and testing involving person's - 

from the subject drea...development projects are often excellent 
sites for fundamental. research rel op. 2) ° ; 


“The history of ihe ALPBP project ‘is based on Be ‘Lois-ellin Data's 
presentation ac. the LPA’ AS EnpOS Lm: in Warrenton,: Megiata, March 13, 1981. 


“4 : S . ome 


Educational Research and Development (1980) to devaton entry/exit ‘efitaria se 
of Bilingual Education and Minority: Language Affairs. (OBENLA) Useful as 


concern for the adequacy of the measures. Although the researchers case. the , 


- language proficienty. , 


“research. The notion is based on. the belief that knowledge and application 


the RYDE ria ee> and methodology” er the. research. A. few models of suck lnter= a 


The second. point of ofigin was a national survey of language minority 


students Involving two. studies: _ the Children! $s English and Services Study” 
and the: Meashre of English Language Ser leleny Study (céss- -MELP) : (0'yoi ley, 


1981), and a ie nace administered by. the- Southwest Regional Laboratory for 


¢ 


for bilingual education ‘programs. “Both projects were funded by the, Office: 
the results of these projects are, their development was marked’ by some 


best of what was knowin in sedae: to carry out the survey and develop. she cri- 


. 


teria, they strongly urged | that other studies Support research In the area of oo 


” 


«The. third point of origin was some énthusiasm for what has variously - 


been called interactive research, collaborative development and developmental 


have too long. esen too far apart. In Order. to bridge this gap, it was ae 


ve . 


posed that researchers and shacerejonens meat in order to. mutual ly influence 
4 af 


active research had been carried out (e.g., Tikunof et al., 1979; Tikunoff 
et al., 1980;. Shalaway & Lamer, 1979) and the results seemed promising. 


“4 


Based on these understandings, NIE’ developed an RFP that required inter - 


te eet The RFP states that, ° 
, Two of the most pressing needs in educating “Atiaren from : 25 — 
minority language backgrounds are (1) -to pursue fundamental . eu. 8 ‘es 
research-on the nature of “language proficiency and how it : . 
can be measured, and (2) to provide “teachers. with up-to-date | 


’ : Lo, ‘ re * 


se 


- 


: 7 os 7 : 4 : 
Saale te language proficiency assessment so ‘they -can 
improve their classroom assessment practices. The Purpose 
of this RFP is to solicit proposals for & program of. work 
with two parts: (1) the administration of a competitive. 
research program to support fundamental research on language -° 
proficiency assessment and (2) the operation of an éxperi- 
mental program of teacher training designed to-introduce - - - 
. teachers to current research perspectives on language’. o ® ge 
‘proficiency assessment. {1979,-p. S) a ae 


Since both components were to be. interrelated -a third component, a 
four day symposium, was also implemented as-part of the ALP8P Project. The 
as ; t an : ra : 5 - : 


symposium provided a. forum for practitioners, researchers and policymakers 
to. exchange information regarding language proficiency. The specific pur- a 
poses of the Language Proficiency Assessment (LPA) Sympos ium were tos, 


fo) keep ALP8P researchers informed about multidisciplinary 
research findings; _ ae. A 

< O . provide access and availability of information about 

“felevant research findings to both resegrchers and 
practitioners; ~ 

. , . . a : : ' hoe canes ss 

Oo . relate ldnguage proficiency assessment issues to current 

_ fesearch in the fields of sociolinguistics and the 
ethnography of communication. " & , 


- 


A summary of activities of each component of the -ALPBP project follow. Findings — 


for each phase of the project are. found in éach component report. 


— a 


‘4 


The ALPSP Research Component 


to fund in two cycles, for one year's duration, basic research related to 


language proficiency assessment issues. . Guidelines for soliciting research . 


The specific goals of the research component of the ALPBP project were 


proposals, ened relevant projects and moni toring selected studies are 
described in Saket} in: Usngwage Assessment Project, Progress Report toNIE, 


January 28, 1980. A summary of these activities follows: 


* 


A request. for proposals was written by the ALPBP Project Director. 


lt summarized the issues, which were to be researched. They were: 


Oo Gagnicive abilities and proficiency in a first wad seegnd 

A asi " language; _ | 2 oe oe + 
0°". Setting and préfictency. ina first aad second language; 
om Competence Tn classroom communication; and - aa , i 
fe) Methods for assessing. language proficiencysin a first 


and second language. 
e 


Approximately 217 requests for the Proposa:l Solicitation (ALPBP Research 7 


component = Append i x A) were made during the first funding cycle. Of those, _ 


s ? 


18% were pone from individuals, 19% were from persons associated Beep 


consulting Pipe, 42% were from persons assicated with. a> “univers ev#"Sid 21% 


were from. poraele associated with public service organizations such as schoo | 


district S. an ‘state “departments of education. Of those: soliciaticns sent,: 
143 of, the - requestors actually euphrited proposals. Append B.to the reséarch. 
Report summarizes the categories, methodology, purpose; and budget for each 


proposal . submitted during the first phase of soli¢ttation. 


A review panel was eeleared which was, onposed of. neeee peeeaccnereit and: 


"sractitioners,'’ who were skilled in ] guage assessment issues within the 


classroom setting; | had expertise in ethnography. of communication,~ first and. 


second language. acquisition, Sisnausee assessment, sociplinguistics, ‘psycho~ 
“linguistics, ‘and psychometric. research; and had teaching experience in 


bilingual Seeorang." Piese selected represented scholars from mul tizethnic e 
o. : 2 a Ais ae : re ; 
_ backgrounds with collective expertise in sociolinguistics, first and second 


- 


language acquisition, linguistics, psychology ene Payer omens: eee 


they- represented the Southwest, the West’ Coast, the Midwest, and Canada. 


a of _ : . RS 
Proposdis received were presared for an anonymous review and sent to 
. “ : d- a , 5 : 
panelists for eoelqevalaa clan: From the cross-validation of reviewers! 


a a possible to., rank. proposes |e: “The top rated eens Sy two 


or. three reviewers, with ; an. average (mean) score oF 60 or more, were desig- 


nated co be further eyaluate@by all panelists. 


- : = 


‘ . 


~ . . r . = _ 7 . 7 ; i # 
Proposals were rated on relevance to the prososal. solicitation issues, — 

quality of design, and plan for aroject management. Based on these critera, 

three proposals were selected for the first cycle of funding. They were: 


re -- 


Bilingual Children's -Lan uage Proficiency: An Ethno raphic Study. 


Pe 


Principal. Investigators: Or. Flora V. Roe rigdee= Pca and 
Dr. Lucia Elias- Olivares, University of Illinois at Chicago 


Circle, P.0. Box 4348, Chicago, I}linois 60608; 


> . ~ 
e 


‘Linguistic Interdependence Among Japanese and Vietnamese Immigrant © ° 
~S : Be 


Pe rr ae . = # 
“Students | SN 
‘ Principal bnvestigators: Or. Jim Cummins, Or. Merrill Swain’ 


A . one . 
‘s ; sod 7 : 


and Daina Green, Ontario Instituce for Studies in Education, 


_& 


, 252 Bier Street West, Toronto, Gntarts:. canada MSS. 16; 


Ms. Jean Handseombe and Chau Tran, “North York ‘Board of . 


Education, Wil Towdate, Ontarics “and Ms. .Kazuko. Nakajin3, 
: . 8 wep oe 


Unversity of Toronto, Ontaris;-. 


The Relationshio between. Native Language Reading Comprehension, Second. 
; . \ = 


and Second ‘Lan ua ge Oral Abi tity. 


Language Readin 


_Comorehension, 


a Project Directér: ‘Ms. Betsy J. Tregar, “Boston Public Schools, 


= 4 ae : ; 
™, 


a ao. 


wo 


_ bau Unit, “Boston Schoo | Commi ttee, 26 court Street, “Boston; . 


» * 


Massachusetts 02108; a .. | = es 7 ee 


Principal Investigators: . Maria ‘Brisk, RoseTima Indrisano and. 


a a a 


’ Maria Lombardo, Boston 


oo 


_ revision of the original ALPBP project Request for ‘Proposals. (RP) (Research 


bg ~ 


Report - - Appendix Cc), confirmation of erie First year review panelists! avail: 


ability, to. participate in. the proposal review, and adaptation of the first 
who . . 
year procedures for cece ving and: evaluating incoming: proposals. 


an a 


’ “i 


The Proposal solicitation was sént out-to | Spproxinately 297 individual 
2 En 


and/or Institutions. _of those approximately 26% were new requestors. Of. au 


the individuals who received proposal sales cabin 148 or M1 individual sig 
& é 7 . 
y. Tesponded by submitting proposals. The breakdown of ere year proposals 


by area; nuvposa: methodology, and budget is foune in Appendix D. to the 
; ; : . - : _ / ‘ he eo. . 
Research Report. — sa 7 7 oe . | _e 2. ee 


an, 


As with the first year proposals, eileyewere rated on their relevance to 
the proposal solicitation .issues,. qual ity ‘of design, and plan. for peCiee 


management. Eagcd on~ these critera, three sebasesie were se ractede ithe ie 


° 


: were: _ a. ee ke 


‘Methods of ‘Analyzing Discourse in ghglish and Spanish to Determine 
Language Proficlency 2 _ = oe wee 2 


“= Principal. Investigators: Or. Helen Slaughter, Tueson Unified 


Re 
‘ 


‘ ace! District, Tueson, Arizona. and Pine Ade tan Bennet, Centro. 


\ 
— de Estudios Puertoriquenos, New York, New York; 


. © 
~ os : 


"erie: of Graphic Sasa anid its Erfects On the Acquisition of Literacy 
. TE | 


v7) 


Principal Investigator: Or. Edwardo Hernandez*Chavez, Instituto’ 


de Lengua Y Cultura, Concord, Cal formis: 


a 


Language Proficiency of Mexican-American Third Grade ‘Stu 


"Limited" 


‘A Problem in the Definition and Measurement of Bilingualism  ~ . 
7 & eae - A ani ae " “Baas : * ; ; 
n Principal Investigator: Or. Zoe Ann Hayes, University of Nevada. 


_ lew Vegas, Nevada” 4 


“ 
pions methodology and a Findings: are Found in yhe ALPBP Research Component 
Final Report «Findings are velater tq the, rear areas of research. outlined. 
in the ALPBP Request for Prepesals. Final Reports ‘for each poe are found 


in. the ALPBP Reséarch “Component - Project Final Reports, Phase | and: I. ios, 


» 


"The ALPBP Teacher Training Component, we. ee boats ae ee 7 
— : 7 . — a = “# . _ : . :. 
The teacher. training component of. the ALPBP project was implemented over 


© da 


a period of ae veers in’ two at Pfaren: Aocathons: Tucson, “Arizona and Berkeley, 
~~ a ee ‘ ; a . z . 


California. : _ i ae te " 8637s 2 
hy Tucson, ae teaser training component was. implemented i 


. 


ceeperation ‘with Tucson Unified Schoo! District (tTuso). and ‘the ‘Univers Tey ceo 


s “aw 


Arizona. Tucson. was selected because of the district's interest in providing 


es 3 
en , : al. mi S weseope-wi ch busts training Tn Alters 
teachers, resource. personnel -and admi piste = ee ee a, | 
native modes of assessing langtiage proficiency. = - oe ares 

Se a Rae es * : ea _ _ 
‘ a eae th 2 om ‘ ; , * " : 


Tuso adminstrators Felt that the ALP6P teacher training progred{ in 7 


—_ 


eyprographic/socTol inguistic.« methodologies would comp) emeff their efforts in 


- 9 
developing a nOnvee tena paiguace proPigiescy: assessment instrument, the 


Language peotieraney Meeeute (wey) (Tusp, 1981). 3 3s _— 
oe a oh | | i — Gs x 
The general goal of the training component | of the ALPBP project. was to 


() 
provide a forum wherein ‘teachers and administrators would explore the ee 


, 


tion of ethnographic/sociel inguistic theories and methodologies aophnes to 


\ 


Janguage proficiency assessment practices. In Sede to accomplish. this re 


e 


“bilingual and pono! ingual educators ‘were provided with.a ppaenoroune a linguis- 
. ad 4 . z 
tics, sociolinguistics, ethnography .of speaking, measurement, and research’ 


methodology. The eee outcome of the ere iotag was brat i would enable ae 


” . : n° 


Tucson’ sdueatere to develop more effective language proficiency assessment 


o 


strategies applicable to cheie particular studeat Population. ~“ i 
« a ; . s OO as . a % se 
The egacher craiatng program at Berkeley, California consisted of aoe 
: panier course ‘offered through the University of California. It wadeearttied t pee 
: 7 ; F : : ¥ tote 3 


oo ese x 
=m, : 


84 


yr 


ao % >, 2 4 ae 


"Speaking of Engl tight Teadking’ the Languagdinor ity Studeng .'* The goats = 


* 


~ 


t 


"of the course were: to introduce participating teachérs to thedretical. issues” 


involved in watering. ee minority students. 


« 
= 


The. process of Tie: eee. outcomes, and evaluation foreach of thes 


3 : ae .. - . 7 . tc 
trairfing programs fdéllow+in the. Peports: em es . 
7 & Course on Bi Lingual Language’ Proficiency Assessment - —_ ae 
\o ‘Susan PHI lips. a ge : | 
na ; Department - GF Anthropdicaye A 
= University of Arizona im OT 
Ethnographia/Socjol inguistic Issues dnd: “he” Assessment - . oN 
of Bilifgual’ Students ' Language Prof ici ency 
¢, Charlene Rivera so : a a ne 
ALPBP Project Director nn a % re 
. Carmen Simich * - a ae. —— . 
~~, ALPBP Project Research Associate He 7 = 
: ni) InterAmerica Research Associates, Ino. og a Be 
eo : ~~ . . : : a a 
: ad 4 , : t : ; : ; 
baagatae: Praficiency and Wineel ey’ Students ans oe as 
2+ dim Cummins © — ‘i Wo. oO 
+ The: Ontario Institute for Seadigs. in “Education . ihe 
ea 5 a Lily. Wong Fillmore = * ae oe 
sUniversity of California: at Berkeley. oe gee o 
. 5 . . : * bd ° 7 : ; : : . . . ‘ eA 4 
4 ji : ee. e aoe f . le 
: : : ; ; nA 
= oe * ane 
, " | é J ne - 4 oN 
. ; | \s a P 
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The, Language Proficiency Assessment (LPA) Sympos tum 


= 
) ° 


_The Language Proficiency Assessment (LPA) Symposium, held March 14 - 18, 


1981, at Airlle House in Warrenton, Virginia was planned and -imp]emented as 


x 


part of the ALPEP project. The, LPA Sympos iu’ répresented, a eas Oy, effort 


toward tntegrating both the ingights gained Fron findings: emerging. from, ‘the: 


research. component and the laplemeatation of the teacher training peedrane, of 


the ALPBP project. The Sympos {um provided a -forum where a broad “spectrum of 


. ° 


researchers, practitioners, and policymakers. met to discuss: the major ‘issues: 


a and reseai'ch findings which affect language. proficiency assessment practices. ai 


The. Symposium also provided a Serueurs for @articipants. to make, practical 
recommendations aiveceed at influencing federal and state policies regarding 
oo 


language proficiency assessment research. and ‘peaetices. "Another objective ot ote 


the Sympos ium was to ancolrage the participants to. develop a network of com= - 


‘munication for the Bur pOSe> of ‘exéhanding information and incorporating - this: 
knowledge into ‘their areas of responsibidity... ae a ee 


od 


Researchers were represented by scholars’ involved in, ‘the development of 


wodeis of communicative competence, related empirical research, ‘and the devel- : 


oe 
opinent and validation or tests of language proficiency and/or conmunicative, 


competence. “Pracetttoners included teachers _and schoo! administrators engaged 


in the implementation of programs which require the application of language 


“proficteney assessment strategies. Policymakers were engl viduals who play a0 re 


ag , wee 


. important réle in the funding. of educational research projects related to: 
Vanguage proficiency assessment aid shia are - influential in the estab! ishment 


7 of policy | in. this area. - Be ge 


> & x A re ne 


as The participants interacted through the presentation of papers, reactions: 


to presentations, and informal discussions. The main goals of the Sympos i um 


were selected by the organizers based on a’ “Survey of concerns of researchers. 


and educators. ‘The goals were: ° 
fe) to develop a working definition of. communicative compe tente/ 
‘ language proficiency ; , 


0.. to make recommendations far oe assessment of language 
_ minority Students for the purpose of entry/exit into 
ea “educational programs: and 


o 


o- to dauaias an agenda ‘for Future-research Based on present 
_ and’ pase research, 


- The issues in the area of language proficiency dssessment ranged from - 


theoretical questions regarding che: nature. of communicative competence ae 


tte application of Mesebeeh Findings. . Central. to the discussion of idabuane. 


ee * 
proftclancy assessment was the acknowledged need to clarify ‘the nature and 


scope of communicative eonpetence and. its relationship to languages profieleneys 


wf 5 nae 
Tapics of. dtssiesten in this regard included research Findings concerning the 


- nature of ant ideas s language ‘use and the role of First tad second language 


ins the” learning of Unteracysreloted skills. 


ct 7 
a 


Language tests and gesting methods were also topics addressed by the. 


“participants. Questions were raised as to what these tests anowid be “measuring _ 


and Woy Bany, of the participants were “concerned with the issue of reliability: 


oT currentiy- used language proficiency. assessment instruments as wall as with. 


‘the development of néw, ‘more. appropriate: measures. A mulei-diseiplinary. 
approach te language: profictency asséssinent. “aad che development or: more... ©. 
ay : rar ae 

innovative methods: of: language testing was supported, by participants. An 


* approach | of this type: would: utilize Information from sen areas, as psychology, 


+a : Ber 


ae. - 14 eee 2 


* . . a 


anthropology, and linguistics, :thus providing the opportunity to gain insights 
from differant perspectives into patterns of language use and related topics. 


A sociolinguistic/ethnographic perspective tg. language proficiency assessment, 


. 


° 


— : ; ue - oat 
_ for example, was one’.ef the unique approaches which was examined at the 
gt 7 se 
Symposium. a , 


a 


| ‘The implications of pew research Findings: on the establishment of: govern 
ment polires ‘and in sareteuler, of. federal guidelines: in ‘the area of Tanguage, 


proficiency assessment, was a topic which most: ‘oF the. PaLeTGip ests bel ieved 


fegulred serious ‘consideration: Since Tanguage proficiency assessment prac 
tices are currently endergotne a period of change and yee valuseton: ft was 


suggested that the federal ‘government, in reyistng the LAU guidelines, provide 


a) 


a means ae incorporating new PESeAr en: Findtees ‘regarding the nature of language 


which have implications for assessing minority students. 
= : Rot F. 


; 7 oe ° 


Ne LPA Symposium report consists of three component reports. The first 


is an analysis of the literature and research in the area of language profi- 


ciency assessment and found in the-article: Issues in the Assessment of. 
ae a Pes oo™N wee - 

Language Proficiency of Language Minority Students, by Chatlene Rivera and 

Carmen Simich. The second is a. summary of sympos i um presentations. These 


two EEPOrES provide. inpor tant documentation regarding the state of the a 

of language proficiency assessment. In. addition, chev Gamnediee censane. re: 
‘issues. whitch need to be further documented. / The third component . gee 
‘is a publication dissemination Pian Sse the symposium proceedings which are. was 


te: be poe kenene ehroysh the Center: for Appl ied Linguistics. 


7 ‘wt . ; . ~ ° a: . a . 5 


Conéelusions and Recommendations < 
TT 5 


Conclusions: and recommendations From each ‘component of the ALPBP . 


» Project are Found in "the individual component reports. In general, the- 


- 


goals’ as stated In ‘the original: NIE RFP have been met. 


Fundamental ‘fesgarch on the nature of language Prah crency was under-, 


“eo 


taken and successfully completed. It is recommended, however, based on- 


« 
% 


the experience of Funding one year ceseaneh projects: through the ALPBP 


project, that research should be. funded for two years or Provisions should 


be made to review and Provide additional Funding, to those researchers who. 


\ 


need the time and money to conclude their investigations. 


Two different teacher training mode] Programs were implemented. “They 
provided an Opportunity for interactive research and Gah aborative develop- 
-ment. ‘lq. the case of TUSO, ‘the training Program directly contributed to 


‘that’ dicertets efforts: to PE aNe: their language proficiency assessment . 


‘strategies. The Berkeley training Program offered an opportunity’ for educa- 


“tors from diverse senger districts to partake in an interactive: Process” 


where language Proficiency assessment was viewed as an. integral pore of the 
v7 


mm do: 


‘teaching process. 


cd 


- ¢ 

ine LPA Sympos ium provided a forum for researchers, practitioners, and 
“pol icy makers to" more formal ly interact ane discuss: the major issues and 
research. Findings which affect. language proficiency assessment practices. 


“ein regard to the major issue of else tying, the: concept of communicative. 


compatence, the research Findings as well -as the fortheoning Sympos jum - 


; proceedings consolidate researchers and. practitioners out Tooks. This con- 


oe tribution to the Field is substantial. 


The contribution of the ALPaP project to the development of sentry 
exit procedures is also important. In. addition to providing a framework 
- for the development of several new ‘sneosce competency measures , (cf. 
i“ ALPEP_ Research Project. Report, ALPBP Teaching. Training Report), the ALPBP” 
project has highlighted the.need for undertaking validation studies of | 
al} See ney used language proficiency peal addition, ~it 


' has’ supported résearch which ape rescncs language proficiency From both tran: 


as 
-‘dittonal and non- ‘traditional perspectives. 


Alehouse these contributions to the field. are _slgnificant, there - 


is still a need to continue research in ants area. Thus, if- bs “strongly, 
recommended sae NIE and other finding 3 agencies continue - to consider and.’ 
ue research Into the nature of minority children! s Tanguaae and. its. 
relationship to lariguage proficiency. Lt is éarther recommended apes inter- a 


active research, such as that funded’ through ane ALPBP project, be Supported 


in future Funding, since it is an ideal way. to integrate theory and practice. 
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